A mobile application based on machine learning and music therapy principles for post-stroke upper-limb motor recovery

A stroke is a medical condition caused by a disruption in blood flow to the brain. This can lead to difficulties with everyday activities and movement. Music therapy is a promising new alternative to traditional rehabilitation methods. This therapy uses sound’s natural properties to enhance stroke recovery, improve motor skills and stimulate neural plasticity. This approach motivates people on both a physical and emotional level. Software tools developed to date to aid in motor recovery after stroke rely mainly on external mechanisms and specific hardware components. This limitation restricts the potential scope of these tools. This study aims to examine the effectiveness and mechanisms of using a mobile application with machine learning algorithms and music therapy principles as a complementary intervention for post-stroke motor recovery. This research project has resulted in the development of a mobile app, based on the widely used Fugl Meyer Assessment. The application uses Vision Framework from Apple and a custom Activity Classification CoreML machine learning model to detect an individual's position in a seated posture. It has also been integrated with XCode. The application generates an audio cue when a user successfully completes one of the Fugl-Meyer Assessment activities. To train the model, 340 clips of a variety of exercises have been created. The research sheds light on how this technology can be used to transform neurorehabilitation while also helping to develop accessible and convenient tools that promote stroke motor recovery

Virtual reality interaction in telepresence

The content of this document presents a solution to the main objective of the project: the creation of a bidirectional telepresence system. This system should allow two people to see each other through virtual reality glasses, in real time, as if they were facing each other, in 3D and with consistent geometric proportions, as if they were in the same room. It must also allow the users to move around within the scene. The different options that have been considered will be displayed, as well as the implementation strategy chosen. The final system is integrated with ROS, Linux, Unity, HTC Vive virtual reality glasses and one computer per user. The reason for this choice is detailed later in this report, but we can advance that it is for technical reasons that allow the continuity of this project. Finally, some examples of operation with captures made on the corresponding devices are included.El contenido de este documento presenta una solución al principal objetivo del proyecto: la creación de un sistema bidireccional de telepresencia. Este sistema debe permitir que dos personas puedan verse mediante unas gafas de realidad virtual, en tiempo real, una delante de la otra, en 3D y con proporciones geométricas coherentes, como si estuvieran en la misma sala. También debe permitir la movilidad dentro de la escena generada. Se mostrarán las diferentes opciones que han sido consideradas, así como la solución elegida. El sistema final está integrado con ROS, Linux, Unity, gafas de realidad virtual HTC Vive y un ordenador por usuario. El motivo de esta elección se detalla más adelante en este informe, pero podemos adelantar que es por cuestiones técnicas que permiten la continuidad de este proyecto. Finalmente, se incluyen algunos ejemplos de funcionamiento con capturas realizadas a los correspondientes dispositivos. ?El contingut d?aquest document presenta una solució al principal objectiu del projecte: la creació d?un sistema bidireccional de telepresència. Aquest sistema ha de permetre que dues persones es puguin veure mitjançant unes ulleres de realitat virtual, en temps real, una davant de l?altra, en 3D i amb proporcions geomètriques coherents, com si estiguessin a la mateixa sala. També ens ha de permetre la mobilitat dins de l?escena generada. Es mostraran les diferents opcions que han estat considerades, així com la solució que s?ha escollit. El sistema final està integrat amb ROS, Linux, Unity, ulleres de realitat virtual HTC Vive i un ordinador per usuari. El motiu d?aquesta elecció es detalla més endavant en aquest informe, però podem avançar que és per qüestions tècniques que permeten la continuïtat d?aquest projecte. Finalment, s?inclouen alguns exemples de funcionament amb captures realitzades als corresponents dispositius